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Abstract 

The wideband regime of bit-interleaved coded modulation (BICM) in Gaussian channels is studied. 
The Taylor expansion of the coded modulation capacity for generic signal constellations at low signal-to- 
noise ratio (SNR) is derived and used to determine the corresponding expansion for the BICM capacity. 
Simple formulas for the minimum energy per bit and the wideband slope are given. BICM is found to 
be suboptimal in the sense that its minimum energy per bit can be larger than the corresponding value 
for coded modulation schemes. The minimum energy per bit using standard Gray mapping on M-PAM 
or M 2 -QAM is given by a simple formula and shown to approach -0.34 dB as M increases. Using the 
low SNR expansion, a general trade-off between power and bandwidth in the wideband regime is used 
to show how a power loss can be traded off against a bandwidth gain. 
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I. Introduction and Motivation 

Bit-interleaved coded modulation (BICM) was originally proposed by Zehavi [1] and further 
elaborated by Caire et al. [2] as a practical way of constructing efficient coded modulation 
schemes over non-binary signal constellations. Reference [2] defined and computed the channel 
capacity of BICM under a sub-optimal non-iterative decoder, and compared it to the coded 
modulation capacity, assuming equiprobable signalling over the constellation. When natural 
reflected Gray mapping was used, the BICM capacity was found to be near optimal at high 



signal-to-noise ratio (see Figure 1(a)). Nevertheless, plots of the BICM capacity as a function 



of the energy per bit for reliable communication (see Figure 1(b)) reveal the suboptimality of 
BICM with the non-iterative decoder of [1], [2] for low rates, that is in the power-limited or 
wideband regime. 

Recent work by Verdu [3] presents a detailed treatment of the wideband regime. He studied 
the minimum bit energy-to-noise ratio for reliable communication and the wideband slope, 

i.e., the first-order expansion of the capacity for low . , under a variety of channel models and 
channel state information (CSI) assumptions. These results are obtained by using a second-order 
expansion of the channel capacity at zero signal-to-noise ratio (SNR). Furthermore, using these 
results, he obtained a general tradeoff between data rate, power and bandwidth in the wideband 
regime. In particular, Verdu[3] studied the bandwidth penalty incurred by using suboptimal 
signal constellations in the low-power regime. An implicit assumption of this tradeoff was that 
the power cannot change together with the bandwidth. 



Motivated by the results of Figure 1(b) and by Verdu's analysis [3], in this paper, we give 
an analytical characterization of the behaviour of BICM in the low-power regime. Studying the 
behaviour of BICM at low rates may prove useful in the design of multi-rate communication 
systems where rate adaptation is carried out by modifying the binary code, while keeping the 
modulation unchanged. In the process, we derive a number of results of independent interest for 
coded modulation over the Gaussian channel. In particular, the first two coefficients of the Taylor 
expansion of the coded modulation capacity for arbitrary signal constellations at zero SNR are 
derived, and used to obtain the corresponding coefficients for BICM. We also obtain a closed 
form expression for the minimum for BICM using QAM constellations with natural reflected 
Gray mapping, and we show that for large constellations it approaches -0.34 dB, resulting in a 
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(a) Capacity as a function of SNR. 
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(b) Capacity as a function of 



Fig. 1. Channel capacity (in bits per channel use) with memoryless binary labeling and BICM-ML decoding for multiple signal 
constellations with uniform inputs in the AWGN channel. Gray and set partitioning labeling rules correspond to thin dotted 
and dashed-dotted lines respectively. For reference, the capacity with Gaussian inputs is shown in thick solid lines and the CM 
channel capacity with uniform inputs {3} with thin solid lines. 
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1.25 dB power loss with respect to coded modulation. Using these results, we derive the trade- 
off between power and bandwidth in the wideband regime that generalizes the results of [3] to 
capture the effects of changing both power and bandwidth. 

This paper is organized as follows. Section In] introduces the system model, basic assumptions 



and notation. Section III defines the wideband regime, and presents the low-SNR expansion for 



both coded modulation and BICM. Section IV introduces the general trade-off between power 



and bandwidth. Concluding remarks appear in Section |VJ Proofs of various results are in the 
Appendices. 

II. Model and Assumptions 

We consider a complex-valued, discrete-time additive Gaussian noise channel with fading. 
The A;-th channel output y k is given by 



Vk 



h k VSNRxfc + z k , (1) 



where x k is the k-th channel input, h k a fading coefficient, and z k an independent sample of 
circularly symmetric complex-valued Gaussian noise of unit variance; SNR denotes the average 
signal-to-noise ratio at the receiver. The transmitted, received, noise and fading samples, are 
realizations of the random variables X, Y, Z and H. The fading coefficients h k are independently 
drawn from a density PH(h k ) and are assumed known at the receiver. For future use we define 
the squared magnitudes of the fading coefficients by Xk = \h k \ 2 . For a given fading realization 
h k , the conditional output probability density is given by 

Pr\xMVk\xk, hk) = le-l*-**^**!*. (2) 

The channel inputs are modulation symbols drawn from a constellation set X with probabilities 
Px{x). We denote the cardinality of the constellation set by M — \X\ and by m = log 2 M the 
number of bits required to index a modulation symbol. We define the constrained capacity C % 
(or coded modulation capacity) as the corresponding mutual information between channel input 
and output, namely 



C*(SNR) = - E 



log P x (x')e^ HVEm ^ x -^ +z ^ 2 



\x'ex 



(3) 
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where the expectation is performed over X, Z and H. If the symbols are used with equal 
probabilities, i. e. Px{x) = M~\ we refer to the constrained capacity as uniform capacity, and 
denote it by C" x . 

As we will see later, it proves convenient to consider general constellation sets with arbitrary 
first and second moments, respectively denoted by pLi(X) and ^{X), and given by 



xex 

pL 2 (X)±E[\X\ 2 ] = J2\x\ 2 P x (x). 

x&X 

Practical constellations have zero mean, i. e. ^i(X) = 0, and unit energy, that is ^{X) = 1. 

In order to transmit at rates close to the coded modulation capacity, multi-level coding or 
non-binary codes are needed [4], [5]. Alternatively, in bit- interleaved coded modulation (BICM) 
binary codes are mapped with a binary mapping rule 7 onto non-binary modulations [1], [2]. 
Caire et al. found that BICM with natural reflected Gray mapping and low-complexity non- 
iterative demodulation attains very good performance, close to that of coded modulation with 
equiprobable signalling [2]. For infinite interleaving, the channel is separated into a set of m 
parallel independent subchannels, and one defines the so-called BICM capacity, denoted by Cx n , 
given by 

m 

C A ., 7 (SNR) = ^/( J B, ; r) (4) 



i=i 

m 



5> 



V „-\HVMR{X-x')+Z\ 2 
. l^x'&Xl e 

log r 



2 l^x'ex e 

where Bi denotes the binary input random variable corresponding to the i-th parallel channel 
(see [2] for details), XI are the sets of constellation symbols with bit b in the i-th position of 
the binary label and the expectation is performed over all input symbols x in XI for b = 0, 1, 
and over all possible noise and fading realizations, respectively Z and H. An equivalent, yet 
alternative, definition is given by the following. 

Proposition 1: The BICM capacity can be expressed as 

m ^ 

i=l 6=0,1 

where and C a xi are, respectively, the constrained capacities for equiprobable signalling in X 

b 

and X*. 
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Proof: The proof is given in Appendix |lj[J ■ 
In general, the sets XI have non-zero mean and non-unit average energy. This result reduces the 
analysis of the BICM capacity to that of coded modulation over constellation sets with arbitrary 
first and second moments. 

III. Wideband Regime 

In the wideband regime, as defined by Verdu in [3], the energy of a single bit is spread 
over many channel degrees of freedom, resulting in a low signal-to-noise ratio SNR. It is then 
convenient to study the asymptotic behavior of the channel capacity as SNR — > 0. In general, 
the capacity (in nats per channel use) admits an expansion in terms of SNR, 

C(SNR) = ciSNR + c 2 SNR 2 + o(SNR 2 ), (7) 

where c x and c 2 depend on the modulation format, the receiver design, and the fading distribution. 

Among the several uses for the coefficients C\ and c 2 , Verdu [3] studied the transformation of 
expansion ([7]) into a function of the bit-energy to noise ratio ^ 



No' 

E h SNR 



N C log 2 e 



(8) 



In linear scale for |K one obtains 

iVQ 



C('tWft-# IfOllA^I I (9) 



N J ^ \N N 0hm 




where A§ £ § - § ^ and 



Co = r^, ^ =—■ ^ 



a cj -Bb a log 2 

C 2 log 2 2' iVoiim Cl 

The parameter £ is Verdu's wideband slope in linear scale [3]. We avoid using the word minimum 
for fk , since there exist communication schemes with a negative slope Co, for which the 

JV lim 

absolute minimum value of ^ is achieved at non-zero rates. In these cases, the expansion at 
low power is still given by Eq. (|9]). The derivation of Eq. (|9]) can be found in Appendix [IlJ 

A second important use of the coefficients c x and c 2 was the analysis of the bandwidth penalty 
incurred by using suboptimal constellations in the low-power regime [3]. An implicit assumption 



'This expression has been independently derived in [6]. 

2 This capacity may be the coded modulation capacity, or the BICM capacity. 
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in [3] was the power cannot change together with the bandwidth. In Section IV we relax this 
assumption and give a formula for the trade-off between power penalty and bandwidth penalty 
and apply it to compare BICM with standard coded modulation. 

In the following, we determine the coefficients ci and c 2 in the expansion (|7]) for generic 
constellations, and use them to derive the corresponding results for BICM. Before proceeding 
along this line, we note that Theorem 12 of [3] covers the effect of fading. The coefficients c\ 
and c 2 for a general fading distribution are 

Cl = E[ X ]cr GN c 2 = E[ X 2 ]4 WGN , (ID 

where the coefficients cf" WGN and cf WGN are in absence of fading. Hence, even though we focus 
only on the AWGN channel, all results are valid for general fading distributions. 



A. Coded Modulation 

For the unconstrained case, where the capacity is log(l + SNR), then c\ = 1 and c 2 = — §. 
In [7], Prelov and Verdu determined the coefficients c\ and c 2 for the so-called proper-complex 
constellations introduced by Neeser and Massey [8], which satisfy 

fj! 2 (X) = E[X 2 } = ^VPx(x) = 0, 

where ^' 2 {X) is a second-order pseudo-moment, borrowing notation from the paper [8]. The 
coefficients for coded modulation formats with arbitrary first and second moments are given by 
the following result. 

Theorem 1: Consider coded modulation schemes over a signal set X used with probabilities 
Px(%) in the Gaussian channel. Then, the first two coefficients of the Taylor expansion of the 
constrained capacity C^(SNR) around SNR = are given by 

c 1 = f ^(X)-\ t i 1 (X)\ 2 (12) 

02 = - |/iiW| 2 ) 2 + |// 2 (*) -£{X)\ 2 ). (13) 

When Hx(X) = (zero mean) and / u 2 (A') = 1 (unit energy), 

ci = l, c 2 = - l -(l + \^{X)\ 2 ^ (14) 

and the bit-energy-to-noise ratio at zero SNR is ^ = log 2. 

OJ "0 lim ° 
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Proof: See Appendix |ITTJ ■ 
The formula for c\ is known, and can be found as Theorem 4 of [3]. Also, for proper-complex 
constellations c 2 — — §, as found in [7]. The second-order coefficient is bounded by — 1 < c 2 < 
— |, the maximum (c 2 = —1/2) being attained when the constellation has uncorrected real and 
imaginary parts and the energy is equally distributed among the real and imaginary parts. 

Applied to some practical signal constellations with equiprobable symbols, Theorem [T] gives 
the following corollaries, whose respective proofs are straightforward. 

Corollary 1: For uniform M-PSK, c 2 = -1 if M = 2 and c 2 = -\ if M > 2. 

This result extends Theorem 11.1 of [3], where the result held for QPSK, a simple example 
of proper-complex constellation. 

Corollary 2: When X represents a mixture of N uniform M n — PSK constellations for n = 
1, . . . , N, c 2 — — | if and only if M n > 2 for all rings/sub-constellations n — 1, . . . , N. 
This applies to APSK modulations, for instance. In [3] Theorem 1 1.2 stated the result for mixtures 
of QPSK constellations. 

B. Bit-Interleaved Coded Modulation 

First, for fixed label index, i, and bit value b, let us respectively define the quantities /^(A^), 
\i 2 {X h % ), and /4(<#b), as the mean, the second moment, and the average of the squared symbols 
in the set XI . Then, we have the following. 

Theorem 2: Assume a constellation set X with zero mean and unit average energy. The 
coefficients c\ and c 2 for the BICM capacity C^ i7 are given by 

c i = 5Z |/Xi( ^ )|2 ' (15) 

i=l b 

m 1 / 2 \ 

c 2 = El E faM) ~ M^)l 2 ) - (1 + I/4WI 2 ) + -M?ra| 2 • (16) 

i=l 6=0,1 ^ ' 

Proof: See Appendix [IV] ■ 
Table |I] reports the numerical values for the coefficients C\ and c 2 , as well as the bit signal-to- 
noise ratio ^ and wideband slope £ for various cases, namely QPSK, 8-PSK and 16-QAM 
modulations and Gray and Set Partitioning (anti-Gray for QPSK) mappings. 

In Figure [2j the approximation in Eq. (|9]) is compared with the capacity curves. As expected, 
a good match for low rates is observed. We use labels to identify the specific cases: labels 1 
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TABLE I 

Si and Wideband Slope coefficients ci, c 2 for BICM in AWGN. 

«0 lim 



Modulation and Mapping 

QPSK 8-PSK 16-QAM 

GR A-GR GR SP GR SP 

1.000 0.500 0.854 0.427 0.800 0.500 

0.693 1.386 0.812 1.624 0.866 1.386 

1.592 1.419 -0.904 2.106 -0.627 1.419 

c 2 -0.500 0.250 -0.239 0.005 -0.160 -0.310 

Co 4.163 -1.041 5.410 -29.966 6.660 0.839 



Cl 

Eh 
Eb 

Wolin 



(dB) 



and 2 are QPSK, 3 and 4 are 8-PSK and 5 and 6 are 16-QAM. Also depicted is the linear 
approximation to the capacity around ^ , given by Eq. (|9]). Two cases with Nakagami fading 
are also included in Figure |2} which also show good match with the estimate, taking into account 
that E[x] = 1 and E[% 2 ] = 1 + \ jv for Nakagami-z/ fading. An exception is 8-PSK with set- 
partitioning, for which the approximation is valid for a very small range of rates, since C2 is 
positive and very small, which implies a very large slope. 

In general, it seems difficult to draw general conclusions for arbitrary mappings from The- 
orem [2] A notable exception, however, is the analysis under natural reflected Gray mapping. 

Theorem 3: For M-PAM and Af 2 -QAM and natural, binary-reflected Gray mapping, the 
coefficient c\ in the Taylor expansion of the BICM capacity C^. 7 at low SNR is 

3-M 2 

Cl = 4(M 2 -1)' (17) 
E h 4(M 2 - 1) 

W = \ M2 lQ g 2 " (18) 
Aoiim 3-M 2 

As M — > oo, ^ approaches | log 2 ~ -0.3424 dB from below. 

Proof: The proof can be found in Appendix |VJ ■ 

The results for BPSK, QPSK (2-PAMx2-PAM), and 16-QAM (4-PAMx4-PAM), as presented 

in Table |IJ match with the Theorem. 



and the minimum ^ is 

"0 lim 
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Fig. 2. BICM capacity (in bits per channel use). Labels 1 and 2 are QPSK, 3 and 4 are 8-PSK and 5 and 6 are 16-QAM. Gray 
and set partitioning labeling rules correspond to dashed (and odd labels) and dashed-dotted lines (and even labels) respectively. 
Dotted lines are cases 1 and 6 with Nakagami-0.3 and Nakagami-1 (Rayleigh) fading (an T is appended to the label index). 
Solid lines are linear approximation around |k . 



It is somewhat surprising that the loss with respect to coded modulation at low SNR is 
bounded. The loss represents about 1.25 dB with respect to the classical CM limit, namely 
fk = — 1.59dB. In the next section, we examine in detail the precise extent to which this 

"0 lim 

loss translates into an equivalent loss in power. We will do so by allowing for simultaneous 
variations in power and bandwidth and conclude that using BICM over a fixed modulation for a 
large range of signal-to-noise ratio values, where the transmission rate is adjusted by changing 
the code rate, needs not result in a large loss with respect to more optimal schemes, where 
both the rate and modulation change. Additionally, this loss can be traded off against a large 
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bandwidth reduction. 



IV. Bandwidth and Power Trade-off 



In the previous section we computed the first coefficients of the Taylor expansion of the CM 
and BICM capacities around SNR = 0. In this section we use these coefficients to determine 
the trade-off between power and bandwidth in the low-power regime. We will see how part of 
the power loss incurred by BICM can be traded off against a large bandwidth reduction. 

The data rate transmitted across a Gaussian channel is determined by two physical variables: 
the power P, or energy per unit time, and the bandwidth W, or number of channel uses per unit 
time. In this case, the signal-to-noise ratio SNR is given by SNR = P/(N W), where N is the 
noise spectral density. Then, the capacity measured in bits per unit time is the natural figure of 
merit for a communications system. With only a constraint on SNR, this capacity is given by 
Wlog(l + SNR). For low SNR, we have that 



Following Verdu [3], we consider the following scenario. Let two alternative transmission 
systems with respective powers Pi and bandwidths Wu i = 1,2, achieve respective capacities 
per channel use Q. The corresponding first- and second-order expansion coefficients are denoted 
by cn, C21 for the first system, and C12, C22 for the second. A natural comparison is to fix a power 
ratio AP = P2/P1 and then solve for the corresponding bandwidth ratio AW = W 2 /Wi so that 
the data rate is the same, that is C 1 W 1 = C 2 W 2 . For instance, option 1 can be QPSK modulation 
and option 2 use of a high-order modulation with BICM. 

A. An Approximation to the Trade-off 

When the capacities Ci and C 2 can be evaluated, the exact trade-off curve AW(AP) can be 
computed. For low power, a good approximation is obtained by keeping the first two terms in 
the Taylor series. Under this approximation, we have the following result. 
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Similarly, for coded modulation systems with capacity C^, we have 
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Theorem 4: In a neighbourhood of SNRi = the capacities in bits per second, C1W1 and 

C2W2 are equal when the expansion factors AP and AW are related as 

Aw = (c 22 SNR 1 + o(SNR 1 ))(AP) 2 

cu + csiSNRx + o(SNRi) - c 12 AP' 

for AW 7 as a function of AP and, if C12 7^ 0, 

/ 2 

Cll / C21 C22C n 



AP =—+{ — — SNRi + o(SNR 1 ), (22) 

ci 2 V c i2 q 2 AW/ 



for AP as a function of AW. 



Proof: The proof can be found in Appendix VI 



Remark that we assume SNRi — > 0. As a consequence, replacing the value of AP from 
Eq. ([22]) into Eq. ([21]) gives AW = AW(l + o(SNRi)), which is not exact, but valid within 
the approximation order. 

The previous theorem leads to the following derived results. For simplicity, we drop the terms 
o(SNRi) and replace the equality signs by approximate equalities. 

Corollary 3: For AP = 1, we obtain 

AW K <»g™' , (23) 

Cn + C 2 lbNRi - C12 

and for the specific case cn = C12, AW ~ C22/C21. 

The latter formula has also been obtained by Verdu [3] as a ratio of wideband slopes. 

As noticed in [3], the loss in bandwidth may be significant when AP = 1. But this point is 
just one of a curve relating AP and AW. For instance, with no bandwidth expansion we have 

Corollary 4: For c n = c 12 = 1, and choosing AW = 1, AP ~ 1 + (c 2 i — c 22 )SNRi. 

For signal-to-noise ratios below -10 dB, the approximation in Theorem [4] seems to be very 
accurate for "reasonable" power or bandwidth expansion ratios. A quantitative definition would 
lead to the problem of the extent to which the second order approximation to the capacity is 
correct, a question on which we do not dwell further. 

Another example concerns the effect of fully-interleaved fading. Let us consider a Nakagami-z/ 
fading model, such that the squared fading coefficient Xk = \hk\ 2 follows a gamma distribution. 
The parameter v is a real positive number, < v < 00. Using the values of the moments 
of the gamma distribution, E[x] = 1, and E[% 2 ] = 1 + 1/u, we have that c\ = cf WGN and 
c 2 = (1 + i)cf WGN . Therefore 



February 4, 2008 



DRAFT 



13 



Corollary 5: Consider a modulation set X with average unit energy and used with power P, 
bandwidth W, and signal-to-noise ratio SNR; its capacity in absence of fading is characterized 
at low SNR by the coefficients c\ — 1 and ci. When used in the Nakagami-z/ channel with power 
P v and bandwidth W v , if P v = P,W U = W(l + I), and if W v = W, P v = P(l - f SNR). 
As expected, for unfaded AWGN, when v — > oo, there is no loss. Rayleigh fading {y = 1) 
incurs in a bandwidth expansion of a factor 2 if the power is to be fixed. On the other hand, if 
bandwidth is kept unchanged, there is a power penalty in dB of about 101og 10 (l — c 2 SNR) ~ 
-10c 2 SNR/ log 10 ~ -4.343c 2 SNRdB, a negligible amount to all practical effects since SNR -> 
0. The worst possible fading is — > 0, which requires an unbounded bandwidth expansion or 
an unlimited power penalty. 

B. Trade-off for BICM 

The trade-off between power and bandwidth can also be applied to determine the expansion 
factors when BICM with a non-binary modulation is used rather than, say, QPSK modulation. 
Fig. [3] shows the trade-off between power and bandwidth expansion factors when BICM over 
16-QAM with Gray mapping is used, having taken QPSK as the reference transmission method. 
Results are presented for two values of the signal-to-noise ratio for the QPSK baseline. The exact 
result, obtained by using the exact formulas for C x and C Xn , respectively Eqs. ([3]) and (|6]), is 
plotted along the result by using Theorem |4} 

As expected, for very low values of SNR, the curve for AW diverges as AP approaches the 
value ^ = ^g, or 0.97 dB. This is in line with the fact that the minimum energy per bit required 
for 16-QAM/BICM is -0.63 dB, as given in Table |IJ Close to this limit, small improvements in 
power efficiency are extremely costly in bandwidth resources. On the other hand, this loss may 
be accompanied by a significant reduction in bandwidth, which might be of interest in some 
applications. For instance, a loss of 2.4 dB from the baseline at -18 dB requires a tiny fraction 
of the original bandwidth, about 2%. 

Concerning the last point, the results are exclusive to BICM and the same analysis can be 
applied to a single transmission method with coefficients c\ and c 2 , trading off power against 
bandwidth. In this case, for a given AP we would have 

ci(l-AP)+c 2 SNR 1 1 ' 
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Using QPSK (c x = 1, c 2 = -§) and for SNR = -18 dB a loss of 2.4 dB is linked to using only 
3% of the original bandwidth. We see that QPSK is slightly more inefficient than BICM/16- 
QAM in using the bandwidth, the reason being that it has a lower coefficient c 2 , —0.5 instead 
of —0.16. To any extent, it should not be surprising that communication in the wideband regime 
can be inefficient in using the bandwidth, since we are working in a regime where the main 
limitation is in power. 

For signal-to-noise ratios larger than those reported in the figure, the assumption of low SNR 
loses its validity and the results derived from the Taylor expansion are no longer accurate. 

10 1 r 1 rn 1 1 1 ] 




Fig. 3. Trade-off between AP and AW between QPSK and 16-QAM with Gray mapping. Solid lines correspond to the exact 
tradeoff, while dashed lines correspond to the low-SNR tradeoff. 
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V. Conclusions 

In this paper, we have computed the first two derivatives of the constrained capacity at zero 
SNR for rather general modulation sets, and used the result to characterize analytically the 
bahaviour of BICM in the low-power regime. For binary reflected Gray mapping, the capacity 
loss at low SNR with respect to coded modulation is shown to be bounded by approximately 
1.25 dB. This fact may be useful for the design of systems operating at low signal-to-noise ratios. 

Moreover, we have determined the trade-off at low SNR between power penalty and bandwidth 
expansion between two alternative systems. The trade-off presented here generalizes Verdu's 
analysis of the wideband regime, where the bandwidth expansion for a fixed power was estimated. 
We have shown that no bandwidth expansion may be achieved at a negligible (but non-zero) 
cost in power. A similar trade-off between power penalty and bandwidth expansion for general 
Nakagami-z/ fading has been computed, with similar conclusions as in the point above: bandwidth 
expansion may be large at no power cost, but absent at a tiny power penalty. We have applied 
the trade-off to a comparison between QPSK and 16-QAM. 
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Appendix I 
Proof of Proposition \T\ 

By definition, the BICM capacity is the sum over i = 1, . . . ,m of the mutual informations 
I(Bi, Y). We rewrite this mutual information as 



fce{o,i} 



E E 

be{o,i} 



log T 



Y, x >extPY\x,H{y\ x '> h ) 



log 



2 ^2x'exPY\x,H(y\x',h)_ 
T, x 'exi ^\PY\x,H{y\x' , h) p Y \x,H{y\ x i h ) 



(25) 



(26) 



Py\x,h(v\x, h) lJ2 x 'ex ^\Py\x,h{vW , h) 

where we have modified the variable in the logarithm by including a factor j^p Y \x,ii(y\x, h) in 
both numerator and denominator. Splitting the logarithm, 



log 



E b 

fee{o,i} 



+ 5 E e 



Ex'e^l \k\PY\x,H(y\x',h) 



For fixed 6, the quantity 



E 



be{o,i} 



log 



log^ 



Py\x,h(v\x, h) 
PY\x,H(y\x,h) 



\x\J2x'exPY\x, H (y\x',h) 
\x-\PY\x, H (y\x',hj 



(27) 



(28) 



PY\x,H(y\x,h) 

is the mutual information achievable by using equiprobable signalling in the set XL C" if and, 
similarly, the quantity 



E 



log — 



PY\x,H(y\x,h) 



\x\L x >exPY\x,H{y\ x ' i h ) _ 
is the mutual information achieved by equiprobable signalling in X, C u x . 



(29) 
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Appendix II 
Linear Expansion Capacity 

We start with Q and use Lagrange's inversion formula. The inversion formula transforms a 
function 

C = /i(SNR) (30) 

into its inverse 

SNR = / 2 (C). (31) 

We do an expansion around SNR = 0, which is also C = 0. Applied to our case, the inversion 
formula becomes 



SNR 



SNR 



C + 



1 d ( SNR \ 



/i(SNR) SNR _ ~ ' 2dSNRV.ii (SNR) J 
Using the expansion in (|7]), after some simplifications we get 



C 2 + 0(C 3 ). (32) 

SNR^O 



SNR=^C-^^C 2 + 0(C 3 ). (33) 

Ci c? 



Letting SNR = C ^ and rearranging we obtain 



E h log 2 c 2 log 2 2 



N c x 4 
which leads to 

4 \N d J +U \\N Cl 



C + 0(C 2 ), (34) 



and hence the desired result. 
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Appendix III 
CM Capacity Expansion at Low SNR 

The assumption that the constellation moments are finite implies that E[|X| 2+Q ] < oo for 
a > 0. Therefore, as SNR — > 0, for ji > the technical condition 



SNR 2+a E [|^| 2+a ] < (- log v/SNRy , (35) 

necessary to apply Theorem 5 of [7] holds. 

Let us define a 2 x 1 vector x^ = (x r Xi) T , with components the real and imaginary parts of 
symbol x, respectively denoted by x r and X{. The covariance matrix of x^'\ denoted by cov(X), 
is given by 



E[(X r -x r ) 2 ] E\(X r - x r )(Xi - Xi. . . 
cov(X) = [V J 1 LV A /J , (36) 

EftXr-XrHXi-Xi)] EKXi-Xi) 2 } 

where x r and Xi are the mean values of the real and imaginary parts of the constellation. 
Theorem 5 of [7] gives c\ = Tr(cov(X)) and c 2 = — Tr(cov 2 (X)), or 

c x = E[(X r - x r ) 2 } + E[(X t - x^ 2 } (37) 
C2 = - (E 2 [{X r - x r ) 2 } + E 2 [(X, - Xi ) 2 } + 2 E 2 [(X r - x r ){Xi - Xi)] y (38) 



The coefficient c\ coincides with that in Eq. ( |T2| ). 

As for c 2 , let us add a subtract a term E[(X r — x r ) 2 } E[(Xj — Xi) 2 } to Eq. ( |3~8] ). Then, 



c 2 = - (| E 2 [(X r - x r ) 2 ] + | E 2 [(X - x,) 2 ] + E[(X r - x r ) 2 } E[(X - x t 



,2l 



iE 2 [(X r -x r ) 2 ] + |E 2 [(X-x i ) 2 ] 



- E[(X r - x r ) 2 ] E[(X — Xi) 2 ] + 2 E 2 [(X r - x r ) (Xi -£ t j\), (39) 
which in turn can be written as 

c 2 = -i( E 2 [|X-x| 2 ] + |E[(X-x) 2 ]| 2 ), (40) 



a form which coincides with Eq. (jT3j), by noting that 

|2 



E[|X-x| 2 ] =E[|X| 2 ] - \x\ 2 = fi2(X) - \fn(X)y (41) 
E[(X - x) 2 } = E[X 2 } -x 2 = fi' 2 (X) - fil(X). (42) 
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Appendix IV 
Proof of Theorem [2] 

In Eq. ([6]) for the BICM capacity, the summands C x an d C x % admit each a Taylor expansion 
given in Theorem [T] Hence, 

Cl = E 2 E ( X " ~ l^^)| 2 )) (43) 



i=l 6=0,1 



E( f 1 - ^ E ^ra) + ^ E iA*i(^)i a ) ( 44 ) 

i=l V ^ 6=0,1 ' 6=0,1 / 

t=l \ K seX 1 1 seA" 1 1 7 6=0,1 ggA* 1 1 / 
m 

Eo Ei^rai 2 ' ( 46 ) 



2 

i=l 6=0,1 



since | 2~^6=o,i A^O*?) = ^(X) = 1 by construction. 

As for c 2 , it follows from a similar application of Theorem [TJ 



February 4, 2008 



DRAFT 



20 



Appendix V 

First-order Coefficient for BICM with Gray mapping 

For M-PAM, the Gray mapping construction makes fJ,i(X£) = 0, for b = 0, 1 and all bit 
positions except one, which we take with no loss of generality to be % = 1. Therefore, 

ci = \h*?)\ 2 + \h^)\ 2 = M*?)| a = M*! 1 )! 2 - (47) 

The last equalities follow from the symmetry between and 1. 

Symbols lie on a line in the complex plane with values ±/3(l, 3, 5, . . . , M — 1), with (3 a 
normalization factor f3 2 = 3/(M 2 — 1). This factor follows by setting 2n = M in the formula 
\ Er=i( 2 ^- 1 ) 2 = KM 2 - 1 )* The average symbol has modulus l^i^ )! = (3f, and therefore 

« = \»w\' = 4&£rr (48) 

Extension to M 2 -QAM is clear, by taking the Cartesian product along real and imaginary 
parts. Now, two indices % contribute, each with an identical form to that of PAM. As the energy 
along each axis of half that of PAM, the normalization factor (3q AM also halves and overall c x 
does not change. 
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Appendix VI 

Determination of the Power and Bandwidth Trade-Off 

In order to have the same capacities bandwidth and/or power must change to account for the 
difference in capacity, so that 



Simplifying common factors, we obtain 

P P 2 W 

c 11 + c 21 SNR 1 + o(SNR 1 ) =c 12 -^ + (c 22 + o(SNR 1 ))-|-^SNR 1 . (50) 

J 1 J 1 rr 2 

Or, with the definitions AP = P 2 /Pi, and AW = W 2 /W 1 , 

(AP) 2 

cu + c 2 iSNRi + o(SNRi) = c 12 AP + (c 22 SNRa + o(SNR 1 )) ^— j-, (51) 

and 

Aw = (c 22 SNR 1 + o(SNR 1 ))(AP) 2 

c u + c 21 SNRi + o(SNR0 - c 12 AP' 

This equation gives the trade-off between AP and AW, for a fixed (small) SNR 1; so that the 

capacities of scenarios 1 and 2 coincide. 

Next we solve for the inverse, i. e. for AP as a function of AP. First, let us define the 

quantities a = c 22 SNRx + o(SNRx) and b — en + c 2 iSNRx + o(SNRx). Then, rearranging 

Eq. (|52]) we have a(AP) 2 + ci 2 AWAP - bAW = and therefore 

Ap = -c 12 AW ± y/(c 12 AW) 2 + AabAW 

2a 



= ^f_ 1± . 1+™). (54) 

Often we have c 22 < 0, and then the negative root is a spurious solution. We choose then 

the positive root. Since ab is of order SNRi, we can use the Taylor expansion (1 + At) 1 / 2 = 

l + 2t-2t 2 + o(i 2 ), to write 

Ap _c 12 AW( 2ab 2a 2 b 2 \ 

2a \c 2 2 AW c\ 2 (AW) 2 ) V ' 

c 12 c\ 2 AW P ° j 
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Since SNR4 — > 0, we group the non-linear terms in SNR1 and so get 

Ap = cn + c 21 SN Rl _ c 22 cf SN Rl 

C12 c? 2 AW v 17 

= - + (- ~ SNRi + o(SNR 1 ). (58) 

C12 V c i2 cf 2 AW J 
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